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ABSTHACT 



This work is an application of the methods in obtaining 
the correlation functions. In particular, the method of 
correlation without a "pure" time-delay is presented 
together with the concept of "orthogonal filters", which are 
Laguerre function type filters. Of these filters, the 
non-symmetric Laguerre type is analyzed and used to realize 
a practical correlator designed for low frequency signals. 

The correlator was computer-simulated by the DSL 
subroutine and the results of the autocorrelation of a 155 
Hz sine wave were compared to the results obtained for the 
autocorrelation of a similar wave in the actual correlator. 
A detail description of the design of the correlator and of 
the DSL program used are also presented. 
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I* INTRODUCTION 



The detection of a signal in the presence of noise 
requires a process which becomes more complex when little is 
known of the noise characteristics and of the signal. To 
this end, correlation analysis is one of the most valuable 
techniques used to filter noise from very low level signals. 
In fact, the problem of getting the signal out of noise is 
the major function of analyzing data in many areas today. 

When properly used and understood, correlation provides 
the engineer with a technique as powerful as Fourier 
Analysis or any of the other classical techniques. 
Essentially, correlation analysis and Fourier transform can 
be thought of as duals of each other since in general the 
transform of any extended signal in time is a narrow 
frequency signal and viceversa, and the autocorrelation of a 
single frequency sine wave extends over the entire time 
delay axis. Familiarization then with this technique and 
the ability to shift from the time to frequency to delay 
axes in order to extract more and more useful information 
from a multitude of signals is of the most importance for 
communications and related fields. 

The mathematical background of the correlation 
functions, autocorrelation and crosscorrelat ion, is 
presented first, [Ref. 1,2, 3, 5] together with their 
properties and Fourier transform correspondence. Then, the 
method of obtaining the correlation functions are briefly 
explained. In particular, the practical application of the 
correlation method without a ••pure" time delay is presented. 
This method is based on the application of the concept of 
orthogonal filters which are Laguerie Functions type 
filters. 

A practical application of this method was carried out 
in the laboratory to verify the analysis. The analysis was 
done by means of the DSL subroutine which simulated the 
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II* CORRELATION ANALYSIS* 



Correlation analysis is a technique used to determine 
the spectral characteristics of a signal or the similarity, 
of two different signals. 

A good method of measuring the similarity between two 

signals is to multiply them together, ordinate by ordinate 

and to add the products over the duration of the waveforms. 

The result is a single number which represents the 

similarity between the two wave forms. [Ref. 3] 

The two correlation functions, autocorrelation and 

crosscorrelation, can be explained as follows [Ref. 1,2]: 

Suppose that a stationary, physical process is producing 

the time functions x (t) , x (t) , ... x (t) simultaneously. 

1 2 n 

(A process is said to be stationary if its amplitude 
statistics do not change with time) . It is also assumed 
that: 

(1) The time functions being generated are not zero. Or 
they have zero mean if the time functions correspond to a 
stochastic process 

(2) They do not have a DC component. 

(3) They can be simple or complex periodic waves. 

(4) They may vary in a random fashion. 

Under these conditions, the two correlation functions 
are defined as: 

A* AUTOCORRELATION FUNCTION* [Ref. 1,2] 

The time average autocorrelation function for 
deterministic or known signals is defined for two different 
classes of signals: 

a) signals of finite average power. 

b) signals of finite energy or pulse signals 

For signals of finite average power the definition is: 



pT 

R (a) = lim 1/2T \ x (t) x (t+u) dt (2.01) 

xx T-><» -TJ 1 1 



where "u" represents a time-shift. 

For signals of finite energy the definition is: 

c°° 

R (u) = \ x (t) x (t + u) dt (2.02) 

XX -oo J 1 1 

The autocorrelation of functions generated by a 
stochastic process is defined as: 



R (u) = E[ x (t) x (t+u) ] 

1 1 



(2.03) 



and if the process is ergodic, the autocorrelation function 
is defined as: 



R (u) = R (u) (2.04) 

xx 

In general, the autocorrelation function of a waveform 
x^ (t) is a graph of the similarity between the waveform 

x^(t) and a delayed replica of itself, (t + u) as a function 

of the time shift "u". 

Based on the mathematical definition of 

autocorrelation. Figure 1 shows an elementary device 
designed to obtain the autocorrelation function. Here, the 
signal is multiplied by its delayed replica and the result 
is averaged over a sufficiently long time. The final result 
is the autocorrelation function if u has also been varied 
during the process. This is essentially a time-delayed 
autocorrelator. 
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Figure li Auto correlator Block Diagram. 



1 . 



P ropert ies of the A utoc o rr elation F unct ion . 

The final output of figure 1, that is, the 
autocorrelation function, will always have the following 
characteristics for any x(t) : 

(1) 'When u = 0 the product is maximum. This is 

represented mathematically by Schwartz Inequality: 

JR (u) | < R (0) (2.05) 

XX XX 

(2) The value of the output at u = 0 represents the 
total power of the signal. If x^ (t) is a voltage, then for 

2 

u = 0 , R (0) = x Tr) is the average power of the signal 
xx 1 

(as measured on a 1 ohm resistor) . 

(3) The autocorrelation function is also a 

function of u. 

(4) The shape of the function is characteristic 
of the original signal x^ (t) . 

(5) The autocorrelation function is an even 
function of u. Mathematically: 

R (u) = R (-u) (2.06) 

XX XX 

(6) If x^ (t) contains periodic frequency 

components, then R (u) will contain each of these frequency 

XX 

components. This means that for certain time functions, if 

x (t) is given then R (u) is known which is useful in 
1 xx 

detecting signals by radar. 

(7) For a real process of this kind, the 

autocorrelation function approaches zero as u -->oo . in 

other words, the signal loses coherence as the delay u is 
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increased. So the coherence tine of the original signal is 
measured by that value of u that produces a significant 
reduction in the value of the autocorrelation function. 
The coherence time of any process producing very wideband, 
uniform (white) noise, is practically zero or very short 
because its instantaneous value is nearly independent of the 
value at any other time. 

(8) The autocorrelation function and the power 
spectral density are Fourier transform pairs. So they 
contain the same information, however, the autocorrelation 
function contains this information in the form of a function 
of time rather than frequency. 

Ua thematically: 

r 00 -jwu 

0 (w) = \ R (u) e du (2.07) 

^ • ) xx 



R (u) 

XX 



1/2tt 

-00 




jwu 

e dw 



(2.08) 



The power spectral density of finite average power 



signals is: 



* 



0(w) = lim 1/2T X (w) X (w) (2.09) 

T-^co IT IT 

2 

= lim 1/2T | X (w) ] (2. 10) 

T-7>co 1 T 

where * means the conjugate value of the quantity it refers 
to. The signal has been observed through a window of 
observation of duration T. 

The power spectral density for signals of finite 
energy is: 



* 2 
*<w) = X (w) X (w) = |X (w) | 

1 1 1 



( 2 . 11 ) 
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case: 



This is also true for stochastic processes in which 



R (u) <=> 0( w) (2.12) 

XX 



and 



2 

j*(w) = lim 1/2T E(|X (w)| ) (2.13) 



If the Fourier components of the waveform are 
squared in amplitude, set into phase at the origin of a new 
time scale, and added together, the result is a visual 
picture of the autocorrelation function. 

(9) The process of autocorrelation of a waveform is 
equivalent to passage of the waveform through its matched 
filter. 

Figure 2 shows the autocorrelation function of some 
typical waveforms. 

B* CROSSCOR RELATION FUNCTION* [Ref. 1,2,3] 

Autocorrelation can be easily visualized because it can 
be related to the power density spectrum of Fourier 
Analysis. But crosscorrelation does not have a similar 
analogy. 

Crosscorrelation is concerned with the relationship 

between two different signals generated by some common 

process. In general, the crosscorrelation function of two 

waveforms, x (t) and x (t) is a graph of the similarity 
1 2 

between x { t) and the delayed x (t) , x (t-u) as a function 
1 2 2 

of the delay !, u n between them. 

Mathematically, crosscorrelation is expressed as: 
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Figure 2 i Autocorrelation Functions of some typical Waveforms. 



x ^(t) x 2 (t * u ) du 



(2.14) 



R (u) = lim 1/2T 
xx T 

1 2 



- T S 5 



Figure 3 shows a device, similar to that shown in Figure 
1, designed to obtain the crosscorrelation function from 
its mathematical definition. In this case, one of the two 
signals is delayed, multiplied by the other signal and the 
result averaged over a long enough period of time. The 
result is the crosscorrelation function provided that u has 
also been varied over the process. This is also a 
time-delayed crosscorrelator. 



1 • P ropertie s of the C rossco rr elatio n Function. 

The autocorrelation and the crosscorrelation 
functions have different properties. The properties of the 
crosscorrelation function are: 

(1) The crosscorrelation function is not an even 
function of u. In other words: 



R (u) # R (-u) (2.15) 

xy xy 

However 



R (— u) = R (u) (2.15) 

xy yx 



and this relationship is useful for obtaining R (u) for 

xy 



negative delays. 

(2) The coherence of a signal generated by a 

physical process approaches zero very fast as u approaches 

infinity due to the presence of noise and the uncertainty 

principle. If, added to this, x (t) and x (t) come from 

12 



two different, unrelated processes, then: 
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Figure 3* Crosscorrelator Block Diagram 



R (u) 
xy 



0 



(2.17) 



(3) In the frequency domain there exists a Fourier 
transform pair: 



R (u) <=> W (v) (2.18) 

xy 12 



but in this case, W (w) is sometimes called the spectrum of 

12 

crosscorrelation of the time functions x (t) and x (t) 

1 2 

Crosscorrelation analysis provides a powerful analytical 
tool. The ability to measure the degree to which the signals 
that arise from a common physical phenomenon resemble each 
other as a function of the delay time between them, can 
provide a much deeper insight into the phenomenon being 
studied than a separate analysis of the properties of either 
signal alone. [Ref. 1] 

C. APPLICATIONS OF CORRELATION ANALYSIS* 

1* D et e ction. [Ref. 1,7] 

Correlation analysis plays its most important role 
when noise is to be filtered from very low level signals. In 
this case, noise is any undesired disturbances that mask the 
signal transmitted, and in practice, it is a signal with 
random amplitude variations. In the case of wide band noise, 
the instantaneous value of the signal is nearly independent 
of the value at any other instant which means that the 
coherence time of the process is very short. 
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Signal detection, such as radar detection, is 
basically the solution of a very important problem common to 
all echo-ranging systems: a signal of known waveform is 
transmitted into a medium and is received, unchanged in form 
but inmersed in noise. 

When two functions consisting of a signal, S(t), and 
noise, N ( t) , such as: 



x (t) = S (t) + (t) (2.19) 

x (t) = S (t) + N (t) (2.20) 

2 2 2 



are crosscorrela ted, the result is: 



R (u) 
xx 



lim 1/27 \‘ [S (t)+N (t) ][S (t + u) +N (t+u) ]dt 

T-e-co -T J 112 2 

( 2 . 21 ) 



S S 

1 2 



(u) 



+ R (u) + R (u) + R (U) 

S N NS N N 

12 12 12 



( 2 . 22 ) 



which will approach zero as u approaches infinity. 

If x (t) = x (t) , then the crosscorrelation is: 



R (u) = R (u) + R (u) + R (u) + R (u) (2.23) 

xx SS SN NS NN 



but in this case, 
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(2.24) 



R 

SN 



<u) 



R (u) 
NS 



0 



because the signal S (t) and the noise N (t) are uncorrelated. 

R (u) is the autocorrelation function of the 
SS 

original signal and it is a function of u other than zero 

even for large values of u. R (u) is the autocorrelation 

NN 

function of noise. If the transmitted signal is periodic 

then R (u) becomes very small for large values of u while 
NN 

R (u) does not. so R (u) is almost egual to R (u) and 
SS xx SS 

this result can be used for signal detection. 

In the case of radar detection, the transmitted and 

the received signals are crosscorrelat ed. Let 

x (t) = S (t) + N (t) (2.25) 



be the received signal and 



x (t) = S (t) 

2 2 



(2.26) 



be the transmitted signal. The frequency of the transmitted 
signal is known so that an internal generator in the 
receiver can be used to generate x^ (t) as a second input to 

the correlator. When these two signals are crosscorrelated , 
the result is: 



R (u) = R (u) + R (u) (2.27) 

12 S S NS 

1 2 2 
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(2.28) 



since N (t) and 



S 2 (t) 



are not correlated, then 



B (u) = 0 
NS 

2 



eventually. So 



R (u) 
12 



R 

S S 
1 2 



(u) 



If x (t) is only noise 

1 



[S (t)=0], then 
1 



(2.29) 



R = 0 (2.30) 

s s 

1 2 

so E (u) = 0. This means that if the crosscorrelation 

12 

betveen transmitted and received signal is not identically 
zero, then a useful signal exists in the received 

transmission . 

2. Dire ct ion F ind ing . f R ef. 3 J 

Direction finding is another application of 
crosscorrelation. In this case, the direction of a source of 
arbitrary waveforms (acoustic, electromagnetic, seismic, 
etc) , can be determined by crosscorrelati ng the responses at 
two receivers that may be located far from the source. The 
procedure is represented in figure 4. The waveforms can be 
completely arbitray, and can even be noise. In the figure, 
the wave front gets to receiver 2 first and it will get to 
receiver 1 t seconds later where t = (D/c) cos9 and c is the 

velocity of propagation. The crosscorrelation has its 
maximum at a delay time equal to the difference in 
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X= Dcos^- 

t= (D/c)cosA t Time difference betvreen 
w receptions at receivers. 

r 

c= Velocity of propagation. 



Figure 4i Direction Finding 



propagation time from the source to each of the two 
receivers. Since D is a constant, then the direction to the 
source, which is the angle Q measured between the 
propagation direction and the base line between receivers, 
is a function of the delay t (time difference) . So, if a 

source is at 6 and another is 

1 



at 6 then the 
2 



crosscorrelation of the signals at the 



receivers from both sources will peak at two different 
times. 



This technique can be used to find the direction of 
any disturbance which radiates a plane wave such as cosmic 
noise sources, earthquakes, submarines, and radar or sonar 
targets . 



3. Testing Contro l System R es ponse On -Lin e. f Ref . 3 1 

It is often necessary to determine the transfer 
function or the impulse response of a control system or 
plant which may be in continuous use. In this case, the 
adjustment should be done without taking the control system 
out of work. Crosscorrelation is idealy used for these 
cases, and the adjustment can be performed on-line. 

Figure 5 represents a typical control system. 
Low-level wideband noise is introduced into the servo loop 
and it is cr osscor related with the output. The control 
system acts as a filter and the crosscorrelation represents 
the impulse response of that system. Figure 6 represents a 
typical control system response. 



25 



Crosscorrelatlon 
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Figure 5* Block Diagram of a Control System 




Correctly 
damned-mar. 
response, mar. 
stability. 




Underdamped- 
too high gain. 




Figure 6 i Typical Control System response. 
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nil GENE RAT ION OF THE CORRELATION F UN CTIONS* 



The correlation functions, autocorrelation and 
crosscorrelation, can be generated by three different 
methods. The first two methods (time-domain definition and 
indirect frequency-domain) will be briefly explained in this 
section. The third method (method without pure time delay) 
will be explained in the foilwing sections. This last 
method can generate the correlation functions in a fairly 
easy and inexpensive way and it is the main concern of this 
thesis . 

A* METHOD I: TIME-DOMAIN DEFINITION* [Ref. 1] 

This is an expensive but widely used method. Here, the 
correlation functions are generated by a simple application 
of the mathematical definition of autocorrelation and 
crosscorrelation. 

Figure 1 shows a simple device to obtain the 
autocorrelation function and it consists in a step by step 
solution of equation (2.01). Figure 3 shows the same 
application but for the crosscorrelation function. 

The method consists in delaying one of the signals "u" 
units of time, then both signals under consideration are 
multiplied together and the product is fed into a low-pass 
filter. The filter output is one point of the correlation 
function. The complete correlation function is generated 
when the delay between the two signals is varied. Note that 
if the two functions being correlated are equal except for 
the delay "u", the result is the autocorrelation function. 
Otherwise the result is the crosscorrelation function. 

There are some disadvantages to this method, mainly: 

(1) If the two signals are fluctuating, and if the delay 
«u« is too long, a distortion is introduced in the system. 

(2) Since this method is a discrete process, the total 
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number of points which generate the complete correlation 
function depends upon the number of individual delay devices 
used. 

B* METHOD II: INDIRECT OR FREQUENCY-DOMAIN METHOD* 

One of the properties of the correlation functions is 
the fact that they are related to the power spectrum through 
the Fourier Transforms, the autocorrelation being the 
inverse transform of the auto- spectrum and the 
cross-correlation the inverse of the cross-spectrum. Thus, 
the indirect method consists in transforming to and from the 
frequency domain so that the correlation in the time domain 
is equivalent to a complex conjugate multiplication of the 
signals spectra in the frequency domain. 

This method is expensive and its application is based on 
the Fast Fourier Transform algorithm which is a descrete 
(digital) process and is mainly used for special purpose 
machines. [Ref. 1,8] 

C* METHOD III: METHOD WITHOUT PURE TIMS DELAY* 

The third method used to generate the correlation 
fuactions is based on the fact that either autocorrelation 
or crosscorrelation can be represented as a series expansion 
of orthogonal terms. The problem is now how to obtain the 
coefficients of the series expansion and how to use them in 
order to get practical results in a fairly inexpensive and 
simple way. This method will be fully discussed in the 
following sections. 
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